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SECURITY CONTROL SYSTFM 
TECHNICAL FTFT.n 

The present invention relates to a control system for 
use with a security door, with interlocking or synchronised 
5 doors, or with other means, such as turnstiles, flaps or 
other obstacles, for controlling access to a secured area. 

A typical security door may comprise a revolving door 
divided into, say, four compartments by radially extending 
wings. The wings are coupled centrally at their upper or 

10 lower end to an interlock operated by a control system and 
are typically motor driven, but may alternatively be pushed 
manually. Turnstile systems are generally free to be 
pushed manually. 

The control system may operate, for example, in 

15 response to a card reader. An authorised person wishing to 
pass through the door will then insert their pass card in 
the reader and, provided that their card is recognised, the 
control system then operates the interlock to free the 
revolving door so the user can pass through it. If the 

20 card is not recognised, or if an unauthorised person 
attempts to gain access without use of the pass card 
reader, then the interlock holds the wings of the revolving 
door against movement and so prevents passage through the 
door. 

25 BACKGROUND ART 

Known security doors suffer from a number of potential 
forms of misuse. In particular they are vulnerable to 
"piggy-backing" in which two individuals attempt to pass 
through the door in one compartment, or "tail-gating" in 

3 0 which an unauthorised person enters the compartment 
immediately following the one containing the authorised 
person, or passes through the door in the opposite 
direction. It has previously been proposed to use 
pressure-sensitive door mats in the security door, or to 

3 5 use ultra-sonic sensors to detect the presence of more than 
one person in the door. However these measures have not 
been wholly successful and there remains a need for a 
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security system capable of detecting reliably piggy-backing 
or tail-gating, whilst providing ease of use and only a 
minimum number of false alarms. 

SUMMARY OF THP PP rcTr NT INVKNTTnM 
According to a first aspect of the present invention 
a control system suitable for use with a security access 
device such as a security door comprises a video input 
device which in use captures visual image data from the 
secured region of the device, an image processor for 
processing said image data and deriving at least one 
parameter for discriminating the number of persons present 
in the secured area of the device and a comparator for 
comparing the said parameter derived from the original data 
with a predetermined threshold and producing a 
discriminatory output for use in controlling the interlock 
on the security device depending upon the result of the 
comparison. 

The present inventors have adopted an entirely new 
approach to the detection of tail-gating and piggy-backing, 
based on the use of video data. While the use of video 
data has previously been proposed for the recognition of 
authorised persons, as an alternative, e.g., to the use of 
card readers, the use of video data for piggy-backing 
detection (APB) has not previously been thought desirable 
or possible. On the face of it the complexity of the 
visual data which would be gathered from e.g., a revolving 
transparent door, and the processing overheads involved in 
determining from such data the number of persons present 
provide a major disincentive to the adoption of such 
techniques. By contrast with recognition techniques which 
take place outside the door, APB detection generally has to 
be carried out in the short interval of time during which 
the user is passing through the door and so techniques 
involving large processing overheads tend to be avoided. 
However, the present inventors have realised that with 
appropriate processing, the raw video data can be used to 
yield a simple parameter for comparison with a 



SUBSTITUTE SHEET (RULE 26) 



WO 96/38820 



PCT/GB96/01249 



predetermined threshold, and that the use of video data in 
this manner allows effective APB detection in real time 
using a relatively low-powered processor. The threshold 
may be for a statistic derived from a number of parameters 
in combination. 

Preferably the image processor and discriminator 
comprise a cascaded series of modules, each module being 
arranged to process image data to determine a respective 
parameter, and to compare the parameter with a 
corresponding threshold. 

Preferably the modules are arranged so that when one 
module is able to make a decision at a predetermined 
confidence level, then that module produces the said 
discriminatory output signal, otherwise the said module 
passing image data on to a subsequent module for further 
processing. 

Preferably the modules are arranged generally in order 
of their discriminatory power, with the most powerful 
module receiving the image data first. 

The discriminatory power of a module is a measure of 
its ability to make a discriminatory decision with a 
minimum processing overhead, and so at maximum speed. The 
efficiency of the whole system is maximised by using the 
fastest tests firsts, and only passing on to tests with a 
greater processing overhead when the preceding tests fail 
to meet a predetermined confidence level. 

Preferably the image processor is arranged to capture 
a background image of the door with no person present, and 
to capture a subsequent image of the door with a person 
present and to discard from the second said image video 
data which is unchanged from the background image. 

According to a second aspect of the present invention 
there is provided a method of controlling a security access 
device, such as a security door, including capturing video 
image data from a secured area of the access device, 
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processing said image data and thereby deriving at 
least one parameter for discriminating the number of 
persons present in the secured area, and 

comparing the said parameter with a predetermined 
threshold and producing a discriminatory output for use in 
controlling an interlock on the security device to lock the 
device when more than a predetermined number of persons are 
present in the secured area. 

The present invention also encompasses a security 
access device when fitted with a control system in 
accordance with the first aspect of the present invention 

According to a further aspect of the present 
invention, there is provided a security access device 
including a secured region bounded by one or more wholly or 
partially transparent walls, characterised by a control 
system including a video input device arranged to view the 
secured region, and in that the transparent walls include 
filter means arranged to block or reduce the transmission 
of light in part of the visible/near-visible optical 
spectrum, and in that the video input device has a 
sensitivity/wavelength characteristic generally 
complementary to the transmission characteristic of the 
said filter means associated with the transparent walls 
the visibility to the video input device of objects outside 
the transparent walls thereby being reduced or eliminated 

Revolving security doors, for example, are commonly 
bunt with glass doors. Objects outside the secured area 
are therefore potentially visible to any video security 
control system and may "confuse" any judgement made by the 
control system. This aspect of the present invention 
overcomes this problem by using walls which are transparent 
m one part of the visible/near-visible spectrum and a 
video input device which is sensitive in another part of 
the spectrum. The walls may, for example, be covered by a 
film which blocks transmission in the infra-red. The video 
device may either be selected to be inherently sensitive in 
the infra-red range, and insensitive outside that range 
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or, may be provided with an input filter giving this 
desired sensitivity/wavelength characteristic. 

BRIEF BESCRIPTIQ N OF THF. np&WTMr.g 

Figure 1 is a block diagram of a system embodying the 
present invention; 

Figures 2a and 2b are schematic representations of 
captured video data at different stages of processing; 

Figure 3 shows a set of pixel nasks used in processing 
the image data to detect the head edges shown in Figure 2b; 

Figure 4 is a schematic illustrating the processing of 
the image data to derive the image height and width; 

Figure 5 is a flow diagram for the image processing in 
the APB control circuit; 

Figure 6 is a schematic of hardware for implementing 
the system of Figure l; and 

Figures 7a - 7d are graphs showing experimental data 
obtained using the system of Figure l. 

DETAILED D ESCRIPTION 

An entry control system comprises a revolving door 1 
which, in this example, has four compartments defined by 
radially extending wings 2a-2d. The movement of the wings 
is controlled by an interlock 3 mounted centrally above the 
wings. This interlock operates in a fashion conventional 
in revolving security doors to lock the door against 
movement until an appropriate control signal is received 
from a control unit. 

A card reader 5 is connected to the door controller 4 
and stands outside the door 1. m use, when someone wishes 
to pass through the door, that person inserts their card in 
the reader 5. Provided that the card is recognised, the 
reader 5 outputs an authorization signal to the door 
controller 4 which then operates the interlock 3 to free 
the door which is then driven by a motor through an angle 
sufficient for the authorised user to pass from the 
entrance to the exit of the door. 

Such security door systems are vulnerable to misuse if 
there is piggy-backing, that is to say if a second 



SUBSTITUTE SHEET (RULE 26) 



WO 96/38820 



PCT/GB96/01249 



6 

unauthorised person enters the compartment together with 
the authorised person, or if there is tail-gating, in which 
the unauthorised person passes through the door in another 
of the compartments at the same time as the authorised 
5 person goes through. In the present example, the control 
system for the door further comprises a video camera 6 
which is mounted above the door looking down into an 
underlying compartment. The video data from the camera is 
processed in an APB control circuit 7 to produce a 

10 discriminatory output which goes to the controller 4 for 
the door to operate the interlock 3 to lock the door when 
piggy-backing or tail-gating is detected. 

As illustrated in Figure 5, the APB control circuit 
has a cascaded hierarchical structure. This comprises a 

15 plurality of stages arranged generally in order of the 
discriminatory power of the particular parameter which is 
derived and used. In use, the image data is first subject 
to processing by the first of this hierarchy of stages. If 
that results in the production of a parameter having a 

2 0 value such that a decision on the presence or absence of a 

second person can be made with adequate confidence, then 
the processing is terminated at that stage and an 
appropriate output signal produced and fed to the external 
control unit. If, however, a decision cannot be made based 
25 on the first parameter, then the image data is passed on to 
the next stage in the hierarchy, for further processing and 
the derivation of a further parameter and so on. In this 
way, the system is structured to maximise the processing 
speed and to minimise the average processing overhead for 

3 0 the image data. Just a single parameter may be used for 

the discrimination in the majority of cases, with further 
parameters being derived and tested only in those marginal 
cases where a single parameter does not enable a decision 
to be made with sufficient confidence. 
55 I" the present example, the first stage of the video 

control circuit is a background-subtraction stage. This 
firstly captures a background image of the compartment of 
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the door prior to the entry of the user into the field of 
view of the camera. This background image is stored in 
order to provide a means of identifying changes occurring 
when entry into the door compartment is effected. 
Subsequently, as the user passes into the field of view, 
the system captures a second image, the "present- image.' 
This is compared with the stored background image and those 
pixels which are unchanged are discarded, thereby 
eliminating them from the subsequent processing stages. In 
this example, the comparison is carried out by taking the 
grey scale values in the range 1-255 of each pixel, 
subtracting one from the other and writing a value of 0 for 
each pixel where the result of the subtraction is 0 or is 
less than a predetermined small value, say 10. Where the 
difference is greater than this predetermined threshold, 
then the value written is simply the grey scale value of 
the present image for that pixel. In the course of this 
process a count is maintained of the number of non-zero 
pixels produced and this is used as the first test 
parameter for APB detection. It is found that when two or 
more persons are present the difference count is 
characteristically higher than when a single person is 
present in the door. in some cases however the result of 
the difference count will be too close to the relevant 
predetermined threshold for a reliable determination to be 
made. in this case the video data is passed on for 
subsequent stages of processing and discrimination. 

Referring again to Figure 5, in this example the next 
stage carries out edge detection using the known Sobel edge 
detection algorithm. This algorithm is applied only to the 
non-zero pixels of the image output from the first stage 
and sets those pixels to one of two binary values producing 
a binary image with, for example, edges shown in black on 
a white ground as in Figure 2a. A determination is then 
made of the area inside the edges. This is done by 
stepping a window of dimensions, e.g., io x 10 through the 
image and recording a count for each pixel which is inside 
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the edges and for which none of the pixels of the window 
cross an edge. This count then is a measure of the area 
inside the edges and is related to the area in the view of 
the camera of the shoulders and head of the person passing 
through the door. This measure of the area provides a 
second discriminatory parameter which as in the first stage 
is compared with a respective discriminatory threshold. As 
before, if this comparison produces a result with a 
sufficient degree of certainty, then the processing can be 
terminated at that stage and the discriminatory output 
passed on to the control system 7. if this is not the 
case, then the system passes on to the next stage of 
processing. As illustrated in Figure 4, this calculates 
the height and width of the image defined by the edges, 
calculates the ratio of the two, and compares this with a 
respective predetermined threshold. 

In this example the final processing module carries 
out what has been termed "head edge detection". This uses 
the aliasing characteristic of the "corners" of the 
detected edges. The image data is compared with a set of 
pixel masks of the form shown in Figure 3. A count is 
incremented, and a mark displayed (Figure 2b), for each 
pixel where a match is found with one of the masks. The 
count of the number of matches is then compared with a 
predetermined threshold for the count to provide a further 
discriminatory test. 

When any of the tests produces an output indicating 
that two or more people are in the door, then the control 
system 7 may activate the -interlock to lock the door 
against movement, thereby trapping the users, or may drive 
the door in the reverse direction to expel the users. 

The inventors have found that the discrimination of 
the system can be improved by calculating an additional 
parameter to compensate for the position of an object in 
the door. The parameters discussed above are based on what 
is assumed to be a plan view from above of the person in 
the door. However, if the person is not directly under the 
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camera, then the camera captures part of the side of the 
body too. This extra information would tend to distort the 
measurement and could lead to the mis-classification of a 
tall off-centre person as two people. To avoid this, a 
5 measurement is taken first of the position of the centre 
of the object. This is then compared with the actual 
centre of the camera and an adjustment parameter is set. 
The adjustment parameter takes the form of a ratio by which 
subsequently determined parameters are multiplied. 
10 Figure 7a and Column i of Table i show the 

measurements of the position of the object used for 
determining the adjustment ratio for a sample of 72 test 
images. The higher the number the further the object is 
from the centre of the camera. The images are a selection 
15 from the following categories: a single person; two people; 
people carrying large and small objects; a person carrying 
a large object over their head. 

Figure 7b and Column 2 of the table show the 
difference count parameter, after correction by the 
20 adjustment ratio or "normalising factor" of Figure 7a. 
Note that images 68-70 are large objects carried over the 
top of the head and so result in a large difference count. 
Figure 7c and Column 3 show the (corrected) head area 
parameter. This measurement is a guide to the total area 
25 available to be a head space. images 68-70 would cause 
concern as the values are extremely high. These images 
would fall above the alarm threshold, as 2 people could fit 
under such a large object. Figure 7d shows the 
height/width ratio parameter measuring the compactness of 
30 the image. The lower the value, the more likely that the 
imaged object is two people. 

Table 1 below lists the data illustrated in these 
graphs. Columns l to 3 are identified above. The data 
contained in the other columns are as follows: 
3 5 Column 4 Width 

This is the width of the Head Area region. 
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30 



35 



Column 5 Height 

This is the height of the Head Area region. 
Column 6 Normalised Ratio 

This is the ratio of the width and height. The Normalising 
Factor is used to adjust the ratio depending on the 
position of the object in respect to the centre of the 
camera . 

Column 7 Head Edges 

This measurement is the number of pixel patterns that match 
with a head indicator mask. The greater the number the 
larger the number of head mask matches. 



Column 8 Head Edge Groups 

This is the number of concentrated groups of Head Edges. 
Column 9 Straight Edge Indicator 

This measurement is the number of straight lines found in 
the image. 

Column 10 Volume 

This is the total volume that would encapsulate the object. 

Column 11 Volume Width 

This is the width of volume. 

Column 12 Volume Height 

This is the height of volume. 

Column 13 Volume Ratio 

This is the ratio of the volume height and volume width. 

Not all of the parameters listed in the table need be 
used in any given implementation of the invention. The 
comparators may be arranged to make an "intelligent" 



SUBSTITUTE SHEET (RULE 26) 



WO 96/38820 



PCT/GB96/01249 



decision based on a number of parameters, rather than 
simply applying a single threshold. The system may also 
include a knowledge base so that it can judge each 
situation on the measurements of the current image and 
knowledge gained about the environment the system is 
working with* 

Table 2 lists the subjects used for the different 
images listed in Table 1. 

For the data of this example, the following thresholds 
may be used by the comparators for discrimination: 
Normalised Difference 

Below 750 - Allow entry 

Above 15000 - Refuse entry. Suspect door entry 

Area 

Below 750 - Allow entry 

Above 4500 - Refuse entry. Suspect door entry 
Normalised Ratio 

Above 95 - Allow entry 

Not all measurements have a pass & fail level. For 
example if the ratio is above 95 then we would allow entry. 
If it is below this level, we use other measurements to 
make a decision. 

The system described above may be modified through the 
use of moving images, that is to say the capturing of a 
series of video frames as the person moves through the 
door. This then produces distinctive "constants" which may 
be used as the basis for discriminatory parameters in an 
analogous fashion to the process discussed above. 

In systems embodying the invention, some of the 
processing modules may use appropriately trained neural 
networks. These may be trained on the parameters produced 
by other modules. 

Appropriate thresholds for the different parameters 
used by different modules may be obtained by inspection 
from real sample data such as that illustrated in Figures 
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7a-7d, and or from computer modelling of the environment in 
which the system is to be used. 

Figure 6 illustrates one example of hardware embodying 
the system. A camera 61 views the target scene and passes 
the acquired image to a frame grabber 62. In this 
preferred implementation, the camera views the target scene 
through an IR bandpass filter. An IR bandstop filter which 
may be in the form of a film applied to the walls of the 
revolving door and which is transparent in the rest of the 
visual spectrum is then used to screen the extraneous 
visual field from the field of view of the camera. A light 
source may be provided inside the door to provide 
illumination at levels appropriate to the sensitivity of 
the video camera 61. 

The image from the frame grabber is passed to a single 
board PC 63 which runs image processing software 
implementing the hierarchical modular structure discussed 
above. Once a decision has been made by the control 
program, an output is passed to the door controller 64. 

In the presently described example, the camera 61 is 
a 1/3 inch black and white EI camera (RS845-184) having a 
1/3 inch CS mount DD lens, 2.6mm (RS846-266) . The frame 
grabber is that available commercially as VIDEOBLASTER SE. 
In this example the single board PC uses an Intel 4 36DX2/66 
microprocessor and an ISA bus. The interface to the door 
controller 64 is a standard PC ISA bus serial card. The 
user interface which enables the user to set adjustable 
parameters for the control program may comprise a keyboard 
or keypad and a VDU or LCD display. 

It will be understood that the above components are 
given by way of example only, and that a number of 
alternative implementations are possible. 

The following appendices list, in appendix A, the 
source code for the image processing/discrimination program 
run on the single board PC 63, and, in appendix B, the 
different elements of the program are listed in pseudocode. 
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TABLE 2 



IMAGE NO. 


SUBJECT 


1 to 5 


1 person -positional test 


6 to 10 


1 person -positional test 


11 to 14 


2 people -positional test 


15 to 19 


1 person-positional test 


20 


2 people 


21 to 24 


1 person + brolly 


25 to 2S 


1 person + box 


27 to 29 


1 person -positional test 


30 to 33 


1 person + brolly 


34 to 36 


1 person* box 


37 


1 person + brolly 


38 


2 people 


39 


1 person + box 


40 to 42 


1 person + brolly 


43 


1 person + briefcase 


44 


1 person + brolly 


45 


2 people 


46 to 48 


postbag in door . , 


49 


small single object 


50 


1 person + rucksack 


51-57 


1 person carrying object 


58-60 


1 person + hooded coat 


61-68 


1 person -different arm positions 


69-71 


1 person - box overhead 


72 


1 person -hat 
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/* Mayor - Guard - Door Secuirty Program * 
/* * 
/* 

/* Martin Golding * 
/* ing@ukc.ac.uk * 
/* Written in C using Turbo Borland C * 



// these include other software needed to run the program 

/include <ctype.h> 

/include <dos.h> 

/include <stdio.h> 

/include <stdlib.h> 

/include <iostream.h> 

/include <iomanip.h> 

/include <conio.h> 

/include <math.h> 

/include <graphics.h> 

// the size of the images that we use. Can be modified latter to 
speed 

//up opreation 

int const IMAGE_SIZE = 256; 

// these are used to hold the image imformation 
unsigned char ** Imgl; 
unsigned char ** Img2; 
unsigned char ** Back; 

//a*********************************************,^^ 
// creates space for a new image in memory 

// 

void newlmage (unsigned char * ** i,int size) { 

(*i) = new unsigned char * [size]; 

for (int x=0;x<size;x++) { 

(*i) [x] = new unsigned char[size]; 
if (»((*i)[x])J { 
clrscr ( ) ; 

cout << "\nlmage Error\n\n" ; 

getch(); 

exit(l) ; 

} 

} 

} 

//********************************** **************** 
// deletes space taken up by an image 

// 

void deletelmage (unsigned char*** i,int size) { 
for (int x=0;x<size;x++) { 

if <((*i)[x])) delete ((*i)[x]); 

delete (*i) ; 

} 
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// displays the image on the screen 

void display(unsigned char** imq) / 
int Size = IMAGE_SIZE; 

for (int y = o; y < size; y++) 
for (int x = 0; x < Size; x++) 

PUtpixel( X/ y / lmg[y] [x]/16) ; 

// creates all the space for the images required 
void start () { 

newlraage(&lmgl,256) ; 

newlmage (&Img2 , 256) ; 

newImage(&Back,256) ; 

} 

/ deletes all the space for the images 
void end() { 

deletelmage(&lmgl,256) ; 

deletelmage(&lmg2,256) ; 
^ deleteImage(&Back,256) ; 

// turns the computer into graphics mode so we can see the image 
void startGraphics ( ) { 

int errorcode, graphdriver, graphmode; 

if (registerfarbgidriver(EGAVGA_driver_far) < 0) exit(l); 
graphdriver = VGA; 
graphmode = VGAHI; 

initgraph(4graphdriver, &graphmode, ■ » ) • 
errorcode = graphresult () ; 
if (errorcode != grOk) { 

cout « "Cant do graphics. \n" ; 

exit(l); 

} 

struct palettetype pal; 
getpalette(&pal) ; 

// create gray scale 
for (int i = o; i < pal. size; i++) 
^ setrgbpalette (pal. colors [i], i*4, i*4, i*4) ; 

// resets the computer from graphics mode 

void endGraphics() { 
closegraph ( ) ; 

// use roberts operator to detect a presence of a line 
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void^edgeDetect (unsigned char** imgln, unsigned char- imgOut,int 



int ysize = IMAGE_SIZE; 
int xSize = IMAGE_SIZE; 

double a,b,c,d,rob; 

for(int y=0;y<ysize-l;y++) 
for(int x=0;x<xSize-l;x++) { 

ii (SSnicMMfT 1 that 15 not 

a = double (imgln[y] [x]) ; 
b = double ( imgln [y] [x+1]) ; 
c = double ( imgln [y+i ] [x] ) ; 
d = double ( imgln [ y+i ] [x-ri] ) ; 

rob = sqrt((((a-d)*(a-d))+((b-c)*(b-c)))); 

if (rob>= (double) (level)) // if a line 
imgOutfy] [x] = 255; 

else 

// not 

imgOut[y] [x] = i; 
} else imgOut[y][x] - 0; 



} 



} 

operation*" PiXelS t0 bS 1 inStead of 0 s ° « speed up 

// All the algorithms know a pixel of 0 is not worth looking at. 
void levelBlack (unsigned char** in) { 

for (int y=0;y<lMAGE SIZE;y++) 
for(int X=0;x<IMAGE_SIZE;x++) 

if (in[y][x]— 0) in[y][x] = i; 

// set all the image to be 0 

void blank (unsigned char** in) { 

for (int y=0;y<IMAGE_SIZE;y++y 
for (int x=0;x<IMAGE SIZE;x++) 
} in[y][x]-0; ~ 

//************************i cicit1t i c1c i c i, icic i !i , ici , il i, it i, itii t icicicici!:kic 
the^esSt^ 6 baCkgr ° Und ima * e from the present image and save 

cSar*^ou U t:in? S i? v £)T r " UnSignSd Char ** ^ Unsi * ned 
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int value ; 
long count=0; 

int ImageSize = IMAGE_SIZE; 

for (int y=0;y<lmageSize;y++) 
for (int x=0;x<ImageSize;x++) { 
value = (int) (img[y][x]) . 

given 11 if the isolate value is greater the level 

// then set the out value 
if (abs ((int) (back [y] [x]) -value) >LEVEL) { 

out[y][x] = img[y][x] ; 

count ++ ; 
} else 

//otherwise turn to not worth looking at 
j out[y] [x] = o; 

// return the number of differences 
return (count) ; 

// read in the image file named with 'inFile' 

int ReadlnFile (unsigned char** img, char *inFile) { 

FILE *file; 
int ch; 

if C(file=fopen(inFile / »rb"))==NULL) { 

cout « "Cant open file "« inFile 
^ return(O) ; x " ' 

char Header (5 12] ; 
f read (Header, 1,512, file) ; 

for (int y=0;y<IMAGE_SIZE;y++) 
for (int x=0;x<IMAGE_SIZE;x++) 

if ( (ch=fgetc(file) )==EOF) { 

cout « "Reached end before should have\n»; 
fclose(file) ; ' 
return (0) ; 
} else { 

Img[y][x] = ch ; 

} 

f close (file) ; 
return (1) ; 

} 

// get the details of the image file 

int GetFileInfo(char *inFile, int* grays, int* size) { 
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FILE *file; 

if ( (file=f open (inFile, "rb") )==NULL) { 

cout « "Cant open " « inFile « "\n"- 
return(O); x ' 



char Header [4 3] ; 
fread(Header, 1,43, file) ; 

int GrayLevels ; 
int ImageRes ; 

div_t temp ; 

GrayLevels = (int) Header [41] ; 
GrayLevels = (1 « GrayLevels) ; 
temp = div(512, (int) Header[42]) ; 
ImageRes = temp.guot ; 
*grays = GrayLevels; 
*size = ImageRes ; 

fclose(file) ; 

if (GrayLevels==256) { 
if ( ImageRes=-IMAGE_SIZE) { 
return (1)7 

} else { 

return ( 0 ) ; 

}; 

} else { 

return (0) ; 

}; 

} 

/ ^ ^^^^^^^^^ 

// check the image file is ok and import the file 

int ImportFile (unsigned char** lag, char* inFile) { 

int GrayLevels; 
int Images ize; 

if ( !GetFileInfo( inFile, SGrayLevels, &ImageSize) ) -f 
return (0); " 

} 

if (!ReadInFile(Img, inFile)) return (0) ; 
return (1) ; 

} 

/ /**************************************** jt*^^^^^^^ 
// export the image into a file 

// 

int ExportFile (unsigned char** Img, char* name) { 



SUBSTITUTE SHEET (RULE 26) 



WO 96/38820 



PCT/GB96/01249 



23 



FILE *file; 

static char extfl] ; 

ext[0]='\0'; 

if ((file=f open (name, "rb")) !=NULL) { 

f close (file) ; 
remove (name) ; 

} 

if ( (file=f open (name, "wb") )==NULL) { 

getSh() ( " 0annOt SaVe '-' press an ^ ke y to =ont»); 
} ge c , 

} 

char Header [5 12] ; 

int ImageRes ; 

div_t temp ; 

ImageRes = IMAGE_SIZE; 

Header[41] = 8; 

temp = div( 512, ImageRes) ; 
Header [42] = temp.quot; 

f write (Header, 1,512, file) ; 

int imgSize = IMAGE_SIZE; 

int Val; 

for (int y=0;y<imgsize;y++) 

for (int x=0;x<imgSize;x++) { 
Val=lmg(y][x]; 
fputc (Val, file) ; 



fclose(file) ; 
return (l) ; 
} 

//********************************* ic *i, i ,* i , 1li!icie m iricii *i,i c 

in? a n° U ^ d ilnage - and areas that could be big enough 

// for a head. Using a window of 10x10 9 

ou't^lo^ ° har ** "unsigned char** 

int const WIN = 10; 

int count; 

int result = 0; 

for (int y=0;y<IMAGE_SIZE-WIN;y++) 
for (int x=0;x<IMAGE_SIZE-WIN;x++) { 
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// if 1 should look at this pixel, 0 means dont bother 
if (m[y+WIN/2][x+WIN/2]) { 
count =0 ; 

// count all the ones to look for 
for(int yy=y;yy<y+wiN;yy++) 
for(int xx=x;xx<x+WIN;xx++) { 
if (in[yy] [xx]==look) { 

count ++; 
} else 

break; 

} 

//if they are all to be looked at 
if (count==WIN*W!N) { 

// fill them all in 
for(int yy=y;yy<y+wiN;yy++) 
for(int xx=x;xx<x+WIN;xx++) { 
outfyy] [xx] = 255; 

result++; 



} 

// return all the ones found 

return (result) ; 

} 

//***************** ********************************** 
// detects the head edges using head masks 

int DetectPossibleHeadEdges (unsigned char** img, unsigned char* 
lmgOut) { 

int isize = IMAGE_SIZE; 

int x,y,xx,yy,cnt=0; 

int Xl,x2,x3,x4,x5,x6,x7,x8,x9; 

//go around in a 3x3 window 

for(x=l;x<iSize-3;x++) 

for(y=l;y<iSize-3;y++) 

// dont bother looking at a 0 
if <img[y][xj) { 

II get all 9 elements 
xl=img[y-l] [x-1] ; 
X2=img[y-l][x]; 
x3=img[y-l] [x+1] ; 
x4=img[y] [x-1]; 
x5=img[y][x]; 
x6=img[y] [x+1] ; 
x7=img[y+l] [x-1] ; 
X8=img[y+l][x]; 
x9=img[y+l] [x+1] ; 
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// look at all the 6 masks 

// if found then increase count 

{ t ij^{niij , iia; < ^ < f"" ( " , " <i,r, ""' , -» i, '-»» £ 

e 1 s e i f 

{ imgOut[y][x] = 255; cnt++; > oj^i-xs)) 

} 

// return the numbers of head edges there are 
return (cnt) ; 

} 

// find the height of the object 

int height (unsigned char** in) { 
int x,y; 

int start=-l,end=IMAGE_SIZE+l; 

for(y=0;y<iMAGE_SIZE;y++) { 

for(x=0;x<IMAGE_SIZE;x++) { 
if (in[y][x]==255) { 
start=y; 
break; 

} 

} 

if ( start !=-l) break; 

} 

for (y=IMAGE_SIZE-l;y>=0;y — ) { 

for(x=0;x<IMAGE_SIZE;x++) { 
if (in[y][x]==255) { 
end=y ; 
break; 

} 

} 

^ if (end!=IMAGE_SIZE+l) break; 

if (start==-l) return(O); 
// return the height 
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return (end-start) ; 



//♦i*********************************^ 
// find the width of the object 

int width (unsigned char** in) i 
int x,y; ' 1 

int start=-l,end=IMAGE_SIZE+l; 



for(x=0;x<IMAGE_SIZE;x++) { 

for(y=0;y< IMAGE_S 12 E ; y ++ ) 
if (in[y][x]==255) { 
start=x; 
break; 



} 



} 



} 



if (start! =-i) break; 



for(x=IMAGE_SI2E-l;x>=0;x— ) { 
for(y=0;y<lMAGE_SIZE;y++) 
if (in[y] [x}==255) { 
end=x ; 
break ; 



} 



} 



if (end!=IMAGE_SIZE+l) break; 



if (start==-l) return(O); 
//return the width 
return (abs (end-start) ) ; 

} 

//************************ 

/ / the main program 

int main (int, char* []) { 



********* 



start (); // start up the space for the images 
startGraphics() ; // turn on the graphics 

ImportFile(Back,»back.img»); // load up the background image 

display (Back) ; // display and wait 
getch ( ) ; 

ImportFiledmgl, "frame. img«); // load up the present image 

display (Imgl) ; // display and wait 
getch ( ) ; 



\ » ' ' uiatj. pixels s 

levelBlack(Back) ; // to know what to look for 
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from diff = deduct(Back ' Iin 9l f Img2,17); // take the background 

// forground and get the difference 

display (Img2 ) ; // display the result and wait 
getch ( ) ; 

edgeDetect(Img2,Imgl,30) ; // detect the edges in the image 

display (Imgl) ; // display the result and wait 
getch ( ) ; 

blank (Img2) ; // set the image to all 0s 

int area = FindPossibleHeadSpace (Imgl , Img2) ; // get the total 



display ( Img2 ) ; // display result and wait 
getch () ; 

int h = height ( Img2 ) ; // calculate the height 
int w = width (Img2); // calculate the width 

blank(Imgl); // set the image to all 0s 

int edegs = DetectPossibleHeadEdges (Img2 , Imgl) ; // look for 
possible head edges 

display ( Imgl ) ; // display result and wait 
getch () ; 

endGraphics ( ) ; / / shut down the graphics 
end(); // release all the memory for the images 

cout « "diff\t" « diff « endl; // output the results 
cout « "area\t" « area « endl; 
cout « "width\t" « w « endl; 
cout « "height\t" « h « endl; 

double ratio; 

if (w>h) // calculate the ratio of height/width 
ratio = double (h) /double (w) ; 

else 

ratio = double (w) /double (h) ; 

cout « "ratio\t" « ratio « endl; 
cout « "edges\t" « edges « endl; 



double const RATIO = 0.6; // define the thresholds 
int const EDGE = 45; 
long const DIFF = 10000; 

cout « endl « endl; 

// tell them what you are looking for 
cout « "We will look for a difference of " « DIFF « endl; 
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cout « "We will look for a edges of » « EDGE « endl- 
cout « "We will look for a ratio of " « RATIO « endl; 

cout « endl « endl; 

// see how we have done 
if (diff<DIFF) { 

} else { ° OUt K< "° ne person ~ on differences" « endl; 
^ cout « "two people - on differences" « endl; 

if (edges>EDGE) { 

cout « "two people - on edges" « endl; 
} else { 

cout « "one person - on edges" « endl; 

if (ratio<RATIO) { 

cout « "two people - on ratio" « endl; 
} else { 

^ cout « "one person - on ratio" « endl; 

return(l); // finished 
} 
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APPENDIX B 



//************************************** ^^^^ 
//* Mayor - Sydo Guard - Door Security Program 

//* 
//* 

//* Martin Golding 

//* mg@ukc.ac.uk 

//* Written in sydo-code 

//************** + *** i ,i r i,** + * + + i,. k i ri , + i , iri ,i, + t4titililitiririt t 



*** define the size of the 



//*****************************.** 
image to be 256 

define the number of gray scales as 256 

define a pixel of value 0 

A pixel value of 0 will be given to a pixel that is not to 
be looked at and not used in the evaluation. 

define a pixel in the range 1-255 

A pixel in this range will be looked at and will be used in 
the evaluation. 

define WHITE equals 255. 

define BLACK equals 1. 

define NOTHING equals 0. 

Main part of the program start 

Createlmage Create space for images in the computer. 

ImportBackGround Get the background image. 
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ImportCurrentlmage Get the current image that we need to 



Level OOutOf Image 

■e 

BackGround 
LevelOOutOf Image 
Current 

RemoveBackgroud 



image . 
person/s 
value. The 
the 

threshold 



people . 

Convert the background image so it does 
any 0 value pixels. 

Convert the current image so it does not 
any 0 value pixels. 

Remove the background from the current 

Mark all pixels that are not part of the 

that have moved into view with a 0 

number of differences are assigned to 

DIFFERENCE_VALUE variable. Use a 

level for deduction. 

Decide if value DIFFERENCE_VALUE is strong enough to make a 
decision. 

YES - decide 

NO - carry on 



EdgeDetect 
threshold 



possibly 



FindAreaForHead 



Detect all the edges of the image. Use a 
level for possibility for an edge. 
Find areas within the image that could 
be big enough fcr a head. The number of 
found is assigned to the AREA_VALUZ 



Decide if value AREA_VALUE is strong enough to make a 
decision. 

YES - decide 

NO - carry on 



The 

HEIGHT VALUE 



CalculateHeight 



Calculate the height of the areas found, 
height of the areas is assigned to the 



variable . 



CalculateWidth 
The width 



Calculate the width of the areas found, 
of the areas is assigned to the 
variable. 

Use the HE I GHT_VALUE and the W I DTH_ VALUE 

a ratio of the area found. The ratio 

assigned to the RAT I 0_VALUE variable. 

Decide if value RAT I 0_VALUE is strong enough to make a 
decision. 



WIDTH_VALUE 

CalculateRatio 

to get 
value is 
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YES - decide 
NO - carry on 



person. ?^ ectHeadEd 9- Detect edges that could be part of a 
to the nUmber of P erson e dges found is assigned 

HEAD_EDGES_VALUE variable. 
Teuton. ValUS HEAD - ED ^S_VALUE is strong enough to make a 



YES - decide 
NO - carry on 



processing" ^ be either <««tinued with further 

done. re!tried with different thresholds or a best guess can be 



computer 0616 ^ 11 " 396 ° eletes s P ace for im ^s in the 

end Main part of the program. 
//******************************^,^^ + 

S'S-S image nJSgS? ValUSS 1 A P ° inter t0 the The 
Output Result .- A pointer to the space allocated for the image. 

allocate enough pointers for the columns, 
at each column allocate enough space for the rows. 
//******************************^ #i ^^ t 

SirS-ffi image. ValUeS = A P ° int6r t0 the The 

Output Result : A pointer to the no space. 

delete space in each columns so we delete all the rows, 
delete columns pointers . 
/ /************* *************************** 

ImpcrtFile input Values , A pointer to the image. The name of 
Output Result : The image is either placed in the space for the 

or an error occurs. 
. n Get the information from the file. Make sure it is correct 

size and the number of gray scales. 

if not correct then produce an error. 

Else then read in the file in the space provided. 
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e of the file, 
in the space for the 



e of the file, 
in the space for the 



mage filename) . 

will work o 
pixels in it. 



s : The image we will work on. 
have no 0 value pixels 



no : goto^OOP^f 5 ° f ^ ' 



currentlma'ie;™ "^ U " ' oacK 9 rouna ' the 

the result ' image, a threshold level 
cuSnt^ 31 ^ : rSSUlt ima9e WU1 contain a ima 3e that is the 

image with the background removed. 
The number of differences there are will be given. 

start at the top left hand corner pixel, 
start counting the number of differences at 0. 

LOOP_l : 

get the background image pixel value, 
get the current image pixel value. 

threshold^ difference between these 2 Pixels greater than the 

yes: 

result c °Py the current image pixel into the 

image pixel 

add one to the number of differences. 



let the result image pixel equal NOTHING. 
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move to the next pixel on the right. 

are we on the right hand edge of the image. 

yes : move down one pixel, go back to the 
first lefthand pixel. 

are we on the bottom edge of the image 
no : goto LOOP_l. 

we have completed the process. 

return the value of the number of differences. 
//t****t*****t*t**i** tllHt4 „ 4jMttilttttH 

EdgeDetect input Values .- The image to work on, the 

resulting image, a threshold level 

Output Result : The result image will contain the edges of the 
current image. 3 

start at the top left hand corner pixel. 



square (b-c) ) . 
threshold. 



get the image pixel value. 

is the pixel value equal to NOTHING, 
no : 

copy the current image pixel into the 

let a - current pixel value, 
let b = next left pixel value, 
let c = next down pixel value, 
let d = next left and down pixel value, 
line value = square root ( square (a-d) + 



if line value is greater then the 
yes: 

set result pixel equal to 

no : 

set result pixel equel to 



set result image pixel to NOTHING, 
move to the next pixel on the right. 

are we on the right hand edge of the image minus 1 pixel 
yes : move down one pixel, go back to the 
first lefthand pixel. 

are we on the bottom edge of the image minus l pixel 
no : goto LOOP_l. 

we have completed the process. 
//************************** ************** 

FindAreaForHead input Values : The image to work on, the 

result image. 

Output Result : The result image will contain areas marked 

that are possibly large enough for body features 
Will return the number of areas found. 

define a the sub-window size to be 10 called WIN_SIZE. 
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start at the top left hand corner pixel, 
start counting the number of areas found at 0. 

L00P_1 : 

get the image pixel value. 

is the pixel equal to NOTHING, 
no: 

look around the current pixel in a WIN_SIZE 
window. Count all the pixels that are 

BLACK. 

if the count was equal to WIN_SIZ2*WIN_SIZE 
then all pixels in the window were BLACK. 

count equal to WIN_SIZE*WIN_SIZE . 
yes : 

set all the window of WIS SIZE 

around 

current pixel in the result image 

to 

be WHITE. 

set the area count to be plus I. 

move to the next pixel on the right. 

are we on the right hand edge of the image. 

yes : move down one pixel, go back to the 
first lefthand pixel. 

are we on the bottom edge of the image, 
no : goto L00P_1. 

we have completed the process. 

return the value of the number of areas found. 

//**************************************** 

CalculateHeight Input Values : The image to work on. 

Output Result : The height found in the image. 

go from the top of the image to the bottom, stoc at the 

first 

WHITE pixel found. 

go from the bottom of the image to the too, stOD at the 

first 

WHITE pixel found. 

we have completed the process". 

return the value of the 2 numbers taken from each other. 

CalculateWidth Input Values : The image to work on 

Output Result : The width found in the image 

go from the left of the image to the richt, stOD at the 

first 

WHITE pixel found. 

go from the right of the image to the left, stOD at the 

first 

WHITE pixel found. 

we have completed the process. 
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other. 

CalculateRatio 
value . 

Output Result : 



return the value of the 2 numbers taken away from each 



The width value, the height 



Input Values 

the ratio value. 

if width is greater than the height. 

yes: divide height by width. 

if height is greater than the width 

yes: divide width by height. 

we have completed the process 

return the ratio value. 
//**************************************** 
TestMaskWithWindow 

was ; g^^-SMasMfijBS.-- 



3x3 

maskl 



blanks means a NOTHING value 
'o' means a WHITE value. 

Each element in the mask represents a comparison with the 
window. 
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Input Values : The image to work on, the 



//************** 
DetectHeadEdges 
result image. 

Output Result : The result image will contain points marked that 
are possible points on a body. 
The number of points marked as head edges. 



start at the top left hand corner pixel 
start counting the number of head edges found at 0. 

get the image pixel value. 

is the pixel equal to NOTHING. 



winodow 
indicator 



WHITE, 
counter. 

NOTHING . 



look around current image pixel, in a 3x3 
take values out and test against a head 
mask. 

TestMaskWithWindow( maskl , 3x3 window) 

TestMaskWithWindow( mask2 , 3x3 window)' 

TestMaskWithWindow( mask3 , 3x3 window)' 

TestMaskWithWindowf mask4 , 3x3 window) 

TestMaskWithWindowl mask5 , 3x3 window) ' 

TestMaskWithWindowf masks , 3x3 window).' 

If any mask results to true, 
yes .- 

Set result pixel equal to 
Increment head edge 

no: 

Set result pixel equal to 



SUBSTITUTE SHEET (RULE 26) 



WO 96/38820 PCT/GB96/01249 
37 

move to the next pixel on the right. 

ere we on the right hand edge of the image. 

yes : move down one pixel, go back to the 
fxrst lefthand pixel. 

are we on the bottom edge of the image 
no : goto LOOP_l. 

we have completed the process. 

return the value cf the number of head edges found. 
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38 
CLAIMS 

1. A control system for use with a security access device 
such as a revolving door (1), the control system 
comprising: 

a video input device (6) which in use captures image 
data from the secured region of the access device; 

an image processor (7) for processing the said image 
data and deriving at least one parameter for discriminating 
the number of persons present in the secured region of the 
access device; and 

a comparator for comparing the said parameter derived 
from the original data with a predetermined threshold and 
for producing a discriminatory output for use in 
controlling the interlock (3) on the security device 
depending upon the result of the comparison. 

2. A system according to claim l, in which the image 
processor (7) and discriminator comprise a cascaded series 
of modules, each module being arranged to process image 
data to determine a respective parameter, and to compare 
the parameter with a corresponding threshold. 

3. A system according to claim 2, in which the modules 
are arranged so that when one module is able to make a 
decision at a predetermined confidence level then that 
module produces the said discriminatory output signal, 
otherwise the said module passing image data onto a 
subsequent module for further processing. 

4. A system according to claim 2 or 3 , in which the 
modules are arranged generally in order of their 
discriminatory power, with the most powerful module 
receiving the image data first. 

5. A system according to any one of the preceding claims, 
in which the image processor is arranged to capture a 
background image of the door with no person present, and to 
capture a subsequent image of the door with a person 
present, and to discard from the second said image video 
data which is unchanged from the background image. 
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6. A method of controlling a security access device such 
as a security door including capturing video image data 
from a secured area of the access door; 

processing said image data and thereby deriving at 
5 least one parameter for discriminating the number of 
persons present in the secured area; and 

comparing the said parameter with a predetermined 
threshold and producing a discriminatory output for use in 
controlling an interlock on the security device to lock the 
10 device when more than a predetermined number of persons are 
present in the secured area. 

7. A security access device fitted with a control system 
according to any of claims l to 5. 

8. A security access device including a secured region 
15 bounded by one or more wholly or partially transparent 

walls, characterised by a control system including a video 
input device arranged to view the secured region, and in 
that the transparent walls include filter means arranged to 
block or reduce the transmission of light in part of the 

2 0 visible/near-visible optical spectrum, and in that the 

video input device has a sensitivity/wavelength 
characteristic generally complementary to the transmission 
characteristic of the said filter means associated with the 
transparent walls, the visibility to the video input 
25 device of objects outside the transparent walls thereby 
being reduced or eliminated. 

9. A "device according to claim 8, in which the filter 
means are arranged to block transmission in the infra-red, 
and the video input device is insensitive outside the 

30 infra-red. 

10. A device according to claim 8 or 9, in which the video 
input device includes an input optical filter arranged to 
provide the said sensitivity/wavelength characteristic. 

11. A device according to any one of claims 8 to 10 

3 5 including a control system according to any one of claims 

1 to 5. 
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Fig.1. 
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Fig.2A. Fig.2B. 
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Fig.5. 
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